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Abstract 



Background: Adolescents may get involved in high-risk behaviors. Surveys are the primary, and sometimes the 
sole source of data collection for many high-risk health behaviours. We examined the reliability and validity of the 
psychometric properties of the self-administered Persian version of the 2009 Youth Risk Behavior Surveillance 
System (YRBSS) questionnaire. 

Methods: In a methodological study in summer 2010, 100 Iranian adolescents aged 15-18 years were recruited 
through convenience sampling. The face and content validity were used for the questionnaire validity. In order to 
evaluate the questionnaire's reliability, the Intraclass Correlation Coefficient (ICC) and Cronbach's a were calcu- 
lated for domains and 89 items. 

Results: Among 89 items, the ICC values were below 0.4 (weak reliability) for 2 items (2.25%), 0.4-0.6 (moderate 
reliability) for 10 items (11.24%), 0.6-0.8 (good reliability) for 32 items (35.96%) and 0.8-1 (excellent reliability) for 45 
items (50.56%). The prevalence of most high-risk behaviors was constant in the first and second survey. The value of 
Cronbach's a was 0.73 for intentional and unintentional injuries, 0.77 for tobacco use, 0.86 for alcohol and other drug 
use, and 0.79 for unsafe sexual behaviors. No domain had a mean ICC of below 0.6. Furthermore, 97.75% of the 
items had moderate to excellent reliability. Thus, the Persian YRBSS questionnaire had an acceptable reliability. 

Conclusion: Over the 2-week period, sexual behaviors were reported with less consistency compared to other 
behaviors. In any case, researchers must be aware of the limitation of the data collected through this question- 
naire, particularly in comparison to the domain of sexual behaviors. Overall, 97.75% of the items had moderate to 
excellent reliability. Thus, the Persian YRBSS questionnaire had an acceptable reliability. 
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Introduction 

Adolescents may get involved in high-risk behaviors 
such as smoking, drug abuse and early and unpro- 
tected sexual activity which will jeopardize their 
health in the future. Surveys are the primary, and 
sometimes the sole source of data collection for many 
high-risk health behaviours. 1 The Youth Risk Behav- 
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ior System Surveillance (YRBSS) is systematic epi- 
demiologic surveillance system prepared by the Cen- 
ter for Disease Control and Prevention (CDC) for the 
purpose of monitoring youth risk behaviors. It fo- 
cuses on risk behaviors that develop during youth and 
will result in mortality, morbidity, complications and 
behavioral problems in youth and adulthood. These 
behaviors include unintentional and intentional inju- 
ries, tobacco use, alcohol and other drug use, high- 
risk sexual behaviors that lead to HIV infection, other 
sexually transmitted diseases (STDs) and unintended 
pregnancies, dietary behaviors, physical activity as 
well as weight gain and asthma. 2 ' 3 
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The first version of the YRBSS questionnaire was 
prepared by the CDC for the first national American 
survey. The surveys were conducted biannually and 
the questionnaires were revised prior to each survey, 
if required. In 1997, CDC determined the goals of 
health people in 2010 and thus required the YRBSS 
plan to warrant the information. Therefore, some 
changes were made to the YRBSS in 1999. 4 Finally, 
minor revisions were made to the questionnaire in 
2001, 2003, 2005, 2007 and 2009. 

It is crucial to evaluate the reliability of the survey 
data in order to determine the accuracy of the meas- 
urement scales over time as well as to determine the 
prevalence of high-risk behaviors to identify target 
groups in public health interventions. Inaccurate data 
may easily lead to errors in policy making and 
evaluation of interventions. 5 Reliability studies of 
CDC's youth risk behaviors have indicated a high 
reliability for a wide range of self-reported risk be- 
haviors. 4 " 8 

No systematic surveillance program for adoles- 
cence risk behaviors exists in Iran. Numerous studies 
have been conducted to deal with one or more of the 
adolescent risk behaviors such as drug abuse, 9 ' 10 to- 
bacco use, 11 ' 12 intentional and unintentional injuries, 13 
reproductive health behaviors, 14 high-risk sexual be- 
haviors in boys, 15 obesity 16 and suicide. 17 However, 
only a few studies have dealt with comprehensive 
assessment of high-risk behaviors using the 
YRBSS, 18 ' 19 and they were not based on adolescence 
populations. Since the findings of these surveys are 
helpful for policy making in the field of youth health 
in local, national and international levels, it is essen- 
tial to ensure the accuracy of self-reports for ques- 
tions related to high-risk behaviors. For this purpose, 
many studies have been conducted worldwide to ad- 
dress the reliability of the YRBSS questionnaire. 2,4 ' 20 
A review of these studies indicates that the YRBS 
questionnaire has an acceptable reliability. Neverthe- 
less, due to the self-administered nature of the ques- 
tionnaire, the standardized English version of the 
questionnaire is not applicable in Iran. In addition, the 
cultural and demographic differences warrant validity 
of the YRBSS tool. Since the reliability of the YRBS 
questionnaire has not been studied in Iranian youth 
population, the current study assesses the reliability 
and validity of the psychometric indices of the Per- 
sian version of the self-administered 2009 YRBSS 
questionnaire, as well as presenting the first evalua- 
tion of the reliability and validity of the Persian 
YRBSS questionnaire. 



Materials and Methods 

The present study is a methodological study for the 
purpose of tool validity and reliability. In summer 
2010, 100 Iranian adolescents aged 15-18 years will- 
ing to participate in this survey were recruited 
through convenience sampling. In the first and second 
surveys, 98 adolescents (53 boys and 45 girls) thor- 
oughly completed the questionnaires. Two adoles- 
cents, who had not thoroughly completed the ques- 
tionnaires in the two surveys, were excluded from the 
analysis. The responding rate for the questionnaires 
was 98%. 

The state and national YRBS 2009 questionnaire 
is a standardized self-administered questionnaire con- 
sisting of 87 items. The Persian version of this ques- 
tionnaire (PYRBS) is a self-administered question- 
naire adapted from the 2009 YRBS. Furthermore, a 
few items have been added to cover intentional inju- 
ries and water pipe use, and one item pertaining to 
asthma has been eliminated. The PYRBS question- 
naire consists of 89 items. 

Initially, the YRBSS questionnaire was separately 
translated by two Persian translators. It was then dis- 
cussed by translators and proficient professors of 
health sciences to omit certain problems. The version 
was subsequently edited and commissioned to an 
English professor to be translated back into English. 
The purpose was to ensure the accuracy of the trans- 
lation. Subsequently, the translated (English) and 
original versions of the questionnaire were compared 
and contrasted. The final questionnaire was submitted 
to eight professors in the fields of health, psychology 
and psychiatry of Tehran University of Medical Sci- 
ences, Mazandaran University of Medical Sciences 
and Tarbiat-Modarres University of Medical Sci- 
ences. Due to the relatively low prevalence of self- 
reporting statistics for asthma in Iran, 21 ' 22 the asthma 
related questions were removed. Moreover, due to the 
increased prevalence of water pipe smoking in many 
parts of the world, especially in the Eastern Mediter- 
ranean region, 23 the questions on water pipe smoking 
were added to the smoking questions. 

The pilot study was conducted on 10 adolescents, 
resulting in minor changes in the questionnaire. The 
objective of this stage was to determine whether or 
not the adolescents' inference from the statements of 
the questionnaire was compatible with the implica- 
tions and purpose pursued by the researcher, as well 
as to determine whether or not the adolescents had 
similar inferences from one statement. For this pur- 
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pose, after the adolescents completed the question- 
naires individually, they were inquired about the 
questions and a discussion and evaluation were con- 
ducted after the completion of the task. Subsequently, 
challenges resulting from the first preliminary study 
were discussed by the research group and necessary 
amendments were made. A secondary preliminary 
study was conducted using the same method on 20 
adolescents in order to confirm the accuracy of the 
translation. Based on the findings of the second pre- 
liminary study, minor changes were made on the 
wording used in three questions. The final question- 
naire was submitted to four professors for a final re- 
vision. Ultimately, the face validity and content valid- 
ity were used for the questionnaire validity. 

The Ethics Committee of Tehran University of 
Medical Sciences (code number: 89-01-28-10494) 
approved the data collection protocol of the study. 
Consistent with previous studies, test re-test was 
used. Two series of anonymous questionnaires were 
attributed a code from 1-100. Each adolescent re- 
ceived a code and was advised to memorize it. Each 
envelope contained two coded questionnaires. Ado- 
lescents and their parents expressed their informed 
consent orally for participation in the study. On the 
first referral of data collectors to the houses, the first 
questionnaire was completed by the adolescents. Sub- 
sequently, the data collectors reminded them that they 
would return two weeks later to collect the second 
questionnaire, also completed by the adolescents. In 
order to ensure the confidentiality of questionnaires, 
they were collected in a box. Moreover, the data col- 
lectors reassured the adolescents that their informa- 
tion would remain confidential. 

To assess the reliability of the test re-test, 98 ado- 
lescents aged 15-18 years who had completed the two 
YRBSS questionnaires were enrolled. In order to 
evaluate the questionnaire's reliability, the Intraclass 
Correlation Coefficient (ICC) was calculated for all 
domains and items. Furthermore, Cronbach's a was 
calculated to evaluate the questionnaire's reliability in 
the dimension of internal consistency. In addition, the 
frequency of behaviors in the first and second survey 
was calculated for all items. The following criteria 
were used as quantitative values for ICC: below 0.4 
(weak reliability), 04.-0.6 (moderate reliability), 0.6- 
0.8 (good reliability) and 0.8-1 (excellent reliabil- 
ity). 24 In the present study, questions with ICC values 
of less than 0.6 were revised. Values of Cronbach's a 
above 0.7 were described as good internal consis- 
tency. Data were analyzed using Statistical Package 



for Social Sciences (Version 16 for windows, SPSS 
Inc., Chicago, USA) and STATA version 10. 



Results 

The 98 adolescents aged 15-18 years consisted of 51 
(52%) girls and 47 (48%) boys. The mean age of the 
participants was 16.34 years (SD=1.66). 

The estimated reliability for 89 items of the 
IYRBS questionnaire and the rate of prevalence of 
high-risk behaviors of the first and second survey are 
summarized in Table 1 . Among these items, the ICC 
values were below 0.4 (weak reliability) for 2 items 
(2.25%), 0.4-0.6 (moderate reliability) for 10 items 
(11.24%), 0.6-0.8 (good reliability) for 32 items 
(35.96%) and 0.8-1 (excellent reliability) for 45 items 
(50.56%). The prevalence of most high-risk behaviors 
was constant in the first and second survey. Out of 
the 1 9 questions in the domain of intentional and un- 
intentional injuries, only exposure to bullying by oth- 
ers had an ICC value of below 0.6 (0.54). 

In the domain of tobacco use, 2 out of 12 ques- 
tions had ICC values of below 0.6. Smoking at least 
one cigarette per day over 30 days and experiencing 
water pipe even as little as one or two puffs achieved 
ICC scores of 0.27 and 0.56, respectively. 

In the domain of alcohol and other drug use, 4 out 
of 25 questions had ICC values of below 0.6. Fre- 
quency of drug abuse in life, frequency of opium and 
marijuana use in the last 30 days, frequency of heroin 
use, and having smoking friends achieved ICC scores 
of 0.52, 0.51, 0.54 and 0.46, respectively. 

Out of the 8 questions in the domain of unsafe 
sexual behaviors, experiencing sex with the opposite 
sex and using alcohol or drugs before the last sex 
scored 0.45 and - 0.01, respectively. No question in 
the domain of physical activity and body weight and 
dietary behaviors had ICC score of below 0.6. 
Out of the 5 questions related to other health-related 
issues, history of HIV test, history of asking counsel 
from a teacher, advisor or adult about a personal 
problem, and sleeping hours on weekdays received 
ICC scores of below 0.6. Table 2 demonstrates the 
mean ICC for domains of the YRBSS questionnaire. 
The mean values of ICC for domains of intentional 
and unintentional injuries, tobacco use, alcohol and 
other drug use, high-risk sexual behaviors, body 
weight and dietary behaviors, physical activity and 
other health-related issues were 0.83, 0.73, 0.71, 0.64, 
0.85, 0.82 and 0.60, respectively. 
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Table 1: Reliability index in the dimension of repeatability of questionnaire items and prevalence of high-risk be- 
haviors on first and second surveys. 
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L^ACicioiiiy iui vvciyin luoo \j\ MAdLiuii uuiniy 11 ic idol ol/ 


D 7^ 




n 

LJ 


R^ 

LJO 


31 9 


9Q 1 


days 














U^inn low-fat and low-ralorip food for wpinht or fixa- 

/Oil IU IUVV 1 C4 1 Ctl IU IUVV UC4IUI IC IUUU IUI VVCIUI 11 ICOO UI ll/\Ot 


0.83 


0.85 


o 


,88 


26.5 


27.6 


tion durinn thp la^t 30 dav^ 

liui i uui ii iu ii ic iuo l uu uuy o 














Fasting S24 hours for weight loss or fixation during the 


0.97 


0.95 


o 


,98 


10.2 


9.2 


last 30 days 














Using diet tablets and powders for weight loss or fixation 


0.97 


0.96 


o 


,98 


13.3 


12.2 


during the last 30 days 














Vomitinn or u^inn laxatives for wpinht lo^^ or fixation dur- 

V UI 1 1 1 LI 1 1 y UI UOII IU IQAO LI VCO IUI vv \j iy 1 1 L UOO UI 1 iaqliui 1 UUI 


0.96 


0.95 


o 


97 


8.2 


7.1 


ing the last 30 days 














Drinkinn fruit iiiifp ~>"y timpc: nor Haw Hiirinn thp la^t 7 

LJ 1 1 1 1 1\ 1 1 1 LJ 1 1 U 1 L J U IOC r III 1 ICO ^JC 1 VJdy LJ U 1 1 1 1 LJ IIIC Idol 1 


0.87 


0.80 


0 


91 

, U 1 


3 1 

O . I 


2.1 


days 














Eating vegetable salad S3 times per day during the last 


0.86 


0.80 


o 


,91 


1 


0 


7 days 














Eating vegetables > 3 times per day during the last 7 


0.71 


0.58 


0 


.81 


0 


1.1 


days 














Consuming gaseous drinks and canned food >1 time per 


0.81 


0.72 


0 


,87 


13.1 


14.2 


day during the last 7 days 














Consuming milk and dairy products >3 times per day 


0.87 


0.81 


0 


.91 


2.1 


2.1 


during the last 7 days 














Exercising or having a physical activity >20 minutes, >3 


0.91 


0.86 


0 


,94 


24.5 


22.2 



days during the last 7 days, with the intensity to induce 
perspiration and quickening of breath 
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Fxprri^inn nr havinn a nhv^iral artivitv >?0 minutp^ >5 

1 /\ 1 ulOII IU \J 1 1 1 OA VIII Ol L_/ 1 1 V O 1 1 C4 uLI V 1 1 y — w 1 1 III IU LV^ O j — \-/ 


0.87 


0.81 


0.91 


5.1 


5.1 


H3\/ci Hiirinn thp l3<it 7 rl3\/Q withnut npi*<;niratinn nr niiifk- 

Uayo U U 1 1 1 1 y 11 IC Idol / Uayo, vv 1 LI 1 \J U L UCloUlldllUII \J \ UU 1 OI\ 












oninn nf hroath 

Clllliy KJ\ LMCdLII 












Fyomicinn nr ha\/inn a nhwcinal anti\/it\/ >R0 miniitoc >"1 
□aci l-ioi i iy \j\ i id v ii ly a [Ji i y oiL/d i don v i iy -uu iiiii iulco, — i 


n rq 

U.Uj 


n 

\J . UJ 






0 


Ha\/ Hiirinn tho loot 7 Ha\/c 
Udy UUI II iy LI It; Idol / Udyo 












W^tnhinn T\/ >^ hniirQ. nor Hav nn w/ppkHpu/c; 

v v d LL/i 1 1 1 iy i v — «j i iuui o [J ci udy u 1 1 vv cc wjay o 


0.82 


0.74 


0.88 


42.9 


4? 5 


Plp,\/inn \/iHpn nampQ >^ hni j re; nor Hpa/ nn wppkH3\/<s 

i id y 1 1 iy viucu y d 1 1 1 co — «j i iuui o L/ c i uay u 1 1 vvccrxuayo 


0.91 


0.87 


0 94 


80.6 


83.7 


Partininatinn in cnnrtc at cnhnnl >"1 Hau Hiirinn tho lact 7 
■ di LiL>i|JdLii iy ii i ouui io di oLri iuui — i udy uui n iy ii ic idol / 


n R4 


n 4fi 




Q1 R 

•J I . o 


Rn R 

UU . vj 


Howe 
udyo 












pYpmi^inn mnrp than ?0 minutoc; nn ^nhnnl'c; nh\/<iin3l 

i ac iLrioiiiu iiiuic iiidii c- yj iiiii 1 1 i ico uii oui iuui o uiiyoiLrdi 


0 8? 


0 74 


0.88 


34.7 


22.4 


pduratinn rla 0 , 0 , 












Membership in >1 sports team during the last 12 months 


0.77 


0.66 


0.84 


85.7 


84.4 


Being educated about AIDS at school 


0.61 


0.42 


0.74 


30.9 


28.9 


Taking the HIV test 


0.47 


0.22 


0.65 


19.4 


16.3 


Using sun-blocks rarely or never when leaving home for 


0.95 


0.92 


0.96 


19.4 


18.3 


more than 1 hour 












Asking counsel from an adult, teacher or adviser during 


0.43 


0.16 


0.62 


2.3 


1.1 


the last 12 months 












Sleeping >7 hours at night on weekdays 


0.54 


0.32 


0.69 


78.7 


69.9 


a lntra-class Correlation Coefficient, Bold: Mean ICC below 0.6. 










Table 2: Mean reliability index in the dimension of repeatability of questionnaire items for domains of risk behav- 


iours. 


















ICC a 






Domains Questions (n) 


Mean 


Minimum 


Maximum 


Unintentional and intentional injuries 19 




0.83 


0.54 


0.97 




Tobacco use 12 




0.73 


0.27 


0.92 




Alcohol and other drug use 25 




0.71 


0.46 


0.95 




High-risk sexual behaviors 8 




0.64 


-0.01 


0.92 




Body weight and dietary behaviors 12 




0.85 


0.71 


0.97 




Physical activity 7 




0.82 


0.64 


0.91 




Other health-related issues 5 




0.60 


0.43 


0.95 





a lntraclass Correlation Coefficient 



Considering the diverse nature of the questions 
and the small number of questions in the domains, the 
value of Cronbach's a was not calculable for all the 
domains. The value of Cronbach's a was 0.73 in the 
domain of intentional and unintentional injuries, 0.77 
in the domain of tobacco use, 0.86 in the domain of 
alcohol and other drug use, and 0.79 in the domain of 
unsafe sexual behaviors. 



Discussion 

In the present study, the adolescents' reports over a 2- 
week period were more reliable in the domains of 
intentional and unintentional injuries, body weight 
and dietary behaviors and physical activity compared 
to other domains of risk behaviors. Most items of in- 



tentional and unintentional injuries, tobacco use, al- 
cohol use, substance abuse, nutritional behaviors and 
physical activity had relatively constant frequencies. 
In the short term, these behaviors may be reported 
constant, because few adolescents modify their be- 
havior over a short period of two weeks. Over longer 
durations, these items may be reported with less con- 
sistency since adolescents report their status of sexual 
activity and substance abuse based on their current 
ideas 25 " 27 and thus, those adolescents who change their 
ideas and behaviors will result in more fluctuating 
reports. 26 " 28 

In evaluation of test re-test reliability, inconsistent 
responses on first and second tests may be interpreted 
as response errors. Such discrepancies may reflect an 
actual change. Considering this fact, estimates based 
on the findings of the study must be made with cau- 
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tion. In order to ensure the accuracy of the data, not 
only the reliability, but also the validity of the data 
resulting from self-reporting muse be considered. 
Factors which may influence the validity and reliabil- 
ity of a survey include context of questions and the 
type of responses required from a cognitive point of 
view. 25 Confidentiality and anonymity also exert an 
appreciable impact on response error and increase the 
adolescents' confidence. Furthermore, previous stud- 
ies indicated that the rate of high-risk behaviors, such 
as use of tobacco, alcohol and other drugs, tended to 
be reported higher when using self-administered 
compared to interviewer-administered question- 
naires. 30 One strong point of the present study was the 
use of self-administered questionnaires for adoles- 
cents. Nevertheless, underreporting is a possible 
drawback with this method. 

The present findings indicate a high reliability for 
nutritional behaviors, which may be due to the con- 
sumption of home-made food. Thus, our adolescents 
did not modify their nutritional pattern in the 2 
weeks. The findings of the present study indicate that 
the reliability of items pertaining to sexual behaviors 
is particularly critical. Cultural and legal obstacles 
make it quite difficult for adolescents to answer such 
questions. Due to the modification of present behav- 
iors, adolescents change their report of past behav- 
iors 25 " 27 

In this study, almost 11.24% of YRBSS items 
scored average and 86.52% scored good or excellent 
for ICC. The items pertaining to alcohol or drug use 
prior to intercourse had a weak ICC. These items 
were not reliable, because adolescents who had re- 
ported using alcohol or drugs prior to sex on the first 
survey, did not report it on the second. A study with a 
larger sample size will circumvent this problem. It 
must be noted, however, that due to the unethical, 
illegal and criminal nature of these behaviors in the 
Iranian society, these questions prove particularly 
difficult for respondents to answer. 

Consistent with the present findings, Zulling et al. 
(2006) reported a mean Kappa value of 0.69 for the 
domain of intentional and unintentional injuries, 0.70 



for the domain of tobacco use, 0.43 for the domain of 
alcohol and other drug use, 0.70 for the domain of 
nutritional behaviors, 0.72 for the domain of physical 
activity and 0.60 for the domain of other health- 
related issues. 2 A review of previous studies indicated 
that questions with average or weak reliability were 
found in other cultures as well. In this study, no do- 
main had a mean ICC of below 0.6. Furthermore, 
97.75% of items had moderate to excellent reliability. 
Therefore, the calculated reliability is acceptable for 
all domains, with ICC values of 0.83 for the domain 
of intentional and unintentional injuries, 0.73 for to- 
bacco use, 0.71 for alcohol and other drugs use, 0.64 
for unsafe sexual behaviors, 0.85 for nutritional be- 
haviors, 0.82 for physical activity and 0.60 for other 
health-related issues. 

Over the 2-week period, adolescents consistently 
reported behaviors related to intentional and uninten- 
tional injuries, tobacco use, alcohol and other drug 
use, nutritional behaviors, physical activity and other 
health-related issues. However, sexual behaviors were 
reported with less consistency compared to other be- 
haviors. This inconsistency is particularly problem- 
atic since adolescent sexual health is a significant as- 
pect of public health and is of vital importance for the 
youth. Future revision of the YRBSS to envisage im- 
plicit questions about the adolescents' latest sexual 
contacts are recommended. Researchers must be 
aware of the limitation of data collected through this 
questionnaire, particularly in comparison with the 
domain of sexual behaviors. Future studies on larger 
populations are required. 
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